Feature Extraction Using Supervised Independent Component Analysis by Maximizing Class Distance
نویسندگان
چکیده
Recently, Independent Component Analysis (ICA) has been applied to not only problems of blind signal separation, but also feature extraction of patterns. However, the effectiveness of features extracted by ICA (ICA features) has not been verified yet. As one of the reasons, it is considered that ICA features are obtained by increasing their independence rather than by increasing their class separability. Hence, we can expect that high-performance pattern features are obtained by introducing supervisor into conventional ICA algorithms such that the class separability of features is enhanced. In this work, we propose SICA by maximizing Mahalanobis distance between classes. Moreover, we propose a new distance measure in which each ICA feature is weighted by the power of principal components consisting of the ICA feature. In the recognition experiments, we demonstrate that the better recognition accuracy for two data sets in UCI Machine Learning Repository is attained when using features extracted by the proposed SICA.
منابع مشابه
Feature selection using genetic algorithm for classification of schizophrenia using fMRI data
In this paper we propose a new method for classification of subjects into schizophrenia and control groups using functional magnetic resonance imaging (fMRI) data. In the preprocessing step, the number of fMRI time points is reduced using principal component analysis (PCA). Then, independent component analysis (ICA) is used for further data analysis. It estimates independent components (ICs) of...
متن کاملFeature reduction of hyperspectral images: Discriminant analysis and the first principal component
When the number of training samples is limited, feature reduction plays an important role in classification of hyperspectral images. In this paper, we propose a supervised feature extraction method based on discriminant analysis (DA) which uses the first principal component (PC1) to weight the scatter matrices. The proposed method, called DA-PC1, copes with the small sample size problem and has...
متن کاملFeature Extraction Based on ICA for Binary Classification Problems
In manipulating data such as in supervised learning, we often extract new features from the original features for the purpose of reducing the dimensions of feature space and achieving better performance. In this paper, we show how standard algorithms for independent component analysis (ICA) can be appended with binary class labels to produce a number of features that do not carry information ab...
متن کاملSupervised Feature Extraction of Face Images for Improvement of Recognition Accuracy
Dimensionality reduction methods transform or select a low dimensional feature space to efficiently represent the original high dimensional feature space of data. Feature reduction techniques are an important step in many pattern recognition problems in different fields especially in analyzing of high dimensional data. Hyperspectral images are acquired by remote sensors and human face images ar...
متن کاملImproving Chernoff criterion for classification by using the filled function
Linear discriminant analysis is a well-known matrix-based dimensionality reduction method. It is a supervised feature extraction method used in two-class classification problems. However, it is incapable of dealing with data in which classes have unequal covariance matrices. Taking this issue, the Chernoff distance is an appropriate criterion to measure distances between distributions. In the p...
متن کامل